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The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1)13 Responsive to communication(s) filed on 20 August 2001 . 
2a)D This action is FINAL. 2b)S This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quay/e, 1935 CD. 11, 453 O.G.213. 

Disposition of Claims 

4) ^ Claim(s) 1-40 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) 7-35 and 38-40 is/are rejected. 

7) ^ Claim(s) 36 and 37 is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) S The drawing(s) filed on 20 August 2001 is/are: a)S accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 
Priority under 35 U.S.C. §§ 119 and 120 

12) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 

a)D All b)D Some*c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

13) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 19(e) (to a provisional application) 

since a specific reference was included in the first sentence of the specification or in an Application Data Sheet. 
37 CFR 1.78. 

a) □ The translation of the foreign language provisional application has been received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121 since a specific 

reference was included in the first sentence of the specification or in an Application Data Sheet. 37 CFR 1.78. 



Attachment(s) 

1) 13 Notice of References Cited (PTO-892) 

2) O Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) S Information Disclosure Statement(s) (PTO-1449) Paper No(s) 2 . 



4) d Interview Summary (PTO-413) Paper No(s). 

5) O Notice of Informal Patent Application (PTO-152) 

6) □ Other: 
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DETAILED ACTION 
Specification 
Content of Specification 



(f) Brief Summary of the Invention : See MPEP § 608.01 (d). A brief summary 
or general statement of the invention as set forth in 37 CFR 1 .73. The 
summary is separate and distinct from the abstract and is directed toward 
the invention rather than the disclosure as a whole. The summary may 
point out the advantages of the invention or how it solves problems 
previously existent in the prior art (and preferably indicated in the 
Background of the Invention). In chemical cases it should point out in 
general terms the utility of the invention. If possible, the nature and gist of 
the invention or the inventive concept should be set forth. Objects of the 
invention should be treated briefly and only to the extent that they 
contribute to an understanding of the invention. 



Claim Rejections - 35 USC §112 

The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 



Claims 15-17 are objected because a single claim which claims both an 
apparatus and the method steps of using the apparatus is indefinite under 35 U.S.C 
112, second paragraph. This type of claim is indefinite because it fails to positively 
recite the boundaries sought for protection. The metes and bounds of the claim cannot 
be determined because it is unclear as to which category of subject matter sought or 
protection. 



Claim Rejections - 35 USC § 103 
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The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1-35, 38-40 are rejected under 35 U.S.C. 103(a) as being unpatentable 

over Blatter et al (US Patent Application 2003/0014407 A1) in view of Blum et al (US 

Patent 5,918,223). 

As per claim 1, Blatter discloses a system for making media recommendations 
to users comprising: 

assigning to each media entity of a plurality of media entities (media object, 1f 
0024, line 1) in a data set to at least one class (category, U 0022, line 11-14), each class 
of said at least one class corresponding to a subset of perceptual properties pre-defined 
for the data set (media properties, If 0024, line 2-5); processing each media entity of 
said data set to extract at least one digital signal processing (If 0004, line 12) 
characteristic for each media entity (jf 0022, lines 8-10); each vector includes said at 
least one class and said at least one digital signal processing characteristic (If 0062); 
forming a classification chain (If 0021 , lines 9-1 1 ) 

Blatter does not explicitly teach generating a plurality of feature vectors for said 
plurality of media entities. However, Blum teaches generating a plurality of feature 
vectors for said plurality of media entities (col. 3, lines 14-29). Thus, it would have been 
obvious to one of ordinary skill in the art at the time the invention was made to combine 
the teachings of the cited references to provide the step of generating a plurality of 
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feature vectors for a plurality of media entities in order to allow the database system to 
measure the distance (compare) between the vectors that suitable to the searching of a 
large media object database. 

As per claims 2 and 19, a method according to claim 1, Blum teaches further 
comprising calculating a neighborhood distance within the vector space of said 
classification chain for each of said at least one perceptual class (3, lines 30-34). 

As per claim 3 and 20, a method according to claim 2, Blum teaches wherein 
said neighborhood distance defines a distance within which two vectors in the 
classification chain space are in the same neighborhood (col. 3, lines 35-40). 

As per claim 4 and 21, a method according to claim 2, Blum teaches wherein 
said calculating of a neighborhood distance for each of said at least one perceptual 
class includes determining a distance within which two vectors of the classification chain 
possess the same class given a threshold degree of error (col. 13, lines 55-59). 

As per claim 5 and 22, a method according to claim 4, Blum teaches wherein a 
human determines said threshold degree of error that will be tolerated, said threshold 
degree of error placing a maximum limit on the distance that may be used for 
determining neighborhoods (col. 14, lines 50-54). 

As per claim 6 and 23, a method according to claim 1 , Blatter teaches further 
comprising: processing an unclassified media entity fl| 0063, lines 2-3) to extract at 
least one digital signal processing characteristic for the unclassified media entity flj 
0004, line 12); generating a vector for the unclassified media entity (fl 0062, lines 1-2) 
including said at least one digital signal processing characteristic (U 0004, line 12); 
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presenting the vector for the unclassified media entity to the classification chain fl| 0063, 
lines 2-6); and classifying the unclassified entry with an estimate of at least one 
perceptual class of the classification chain located in the neighborhood of the vector for 
the unclassified entity fl| 0063, lines 7-15). 

Blatter does not explicitly teach calculating the representative at least one 
perceptual class of the subset of the plurality of vectors. However, Blum teaches 
calculating the representative at least one perceptual class of the subset of the plurality 
of vectors (col. 17, lines 29-32). 

As per claims 7-8, a method according to claim 6, wherein said classifying of the 
unclassified entry includes locating the subset of the plurality of vectors of the 
classification chain located in the neighborhood, and wherein said locating includes 
calculating, as the set of vectors of the plurality of vectors of the classification chain 
within the neighborhood distance, the set of vectors of the plurality of vectors of the 
classification chain within a maximum Euclidian distance for classifying new unclassified 
entities within a threshold tolerance (col. 17, lines 45-67). 

As per claim 9, a method according to claim 8, Blum teaches wherein a human 
determines said maximum Euclidian distance for purposes of determining the 
neighborhood vectors within the threshold tolerance (col. 22, lines 12-20). 

As per claim 10 and 25, a method according to claim 6, Blum teaches wherein 
said classifying of the unclassified entry includes classifying the unclassified entry with a 
median class represented by the neighborhood (col. 14, lines 15-21). 
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As per claim 11, a method according to claim 6, Blum teaches wherein said 
class is described by a numerical value and said classifying of the unclassified entry 
includes classifying the unclassified entry with a mean of numerical values found in the 
neighborhood (col. 20, lines 55-65). 

As per claim 12, 26 and 34, a method according to claim 6, Blum teaches 
wherein said classifying includes returning at least one number indicating the level of 
confidence of the class assignment (col. 12, lines 13-21, col. 14, lines 24-36). 

As per claim 13 and 27, a method according to claim 12, Blum teaches wherein 
said classifying includes returning a ratio defined by the number of entries in the 
neighborhood having the representative class over the number of entries in the 
neighborhood not having the representative class (col. 10, lines 41-56). 

As per claim 14 and 28, a method according to claim 12, Blum teaches wherein 
said class is described by a numerical value and said classifying includes returning a 
standard deviation of the numerical values in the neighborhood (col. 14, lines 56-67). 

Claims 15-17 are rejected by the same rationale as state in independent claim 1 
argument. 

Claims 18, 30 and 31 are rejected by the same rationale as state in independent 
claim 1 argument. Furthermore, Blatter teaches classified by humans and digital signal 
processing data as classified by at least one computing device fl| 0021, lines 13-16); 
and processing means for comparing an unclassified media entity to the classification 
chain data structure to determine at least one perceptual class of said unclassified 
media entity flj 0063). 
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As per claims 29 and 33, a computing system according to claim 18, Blatter 
further comprising: an input device for receiving a new unclassified media entity (U 0063 
input object); and an output device for outputting at least one perceptual class of said 
new unclassified media entity based upon said classification chain based upon 
processing of said processing means fl| 0063). 

As per claim 32, a method according to claim 31 , Blatter teaches wherein said 
method is repeated until a sufficientnumber of vectors have been added to said 
classification chain data structure, such that said classification chain data structure 
successfully classifies unclassified media entities within a threshold degree of success 
(110051). 

As per claim 33, a method according to claim 32, further comprising: inputting a 
vector representative of a new unclassified media entity; comparing said vector to the 
vector space of the classification chain data structure; and outputting an estimate of the 
perceptual class of the new unclassified media entity based upon vectors found in a 
neighborhood of the classification chain data structure, wherein a neighborhood of 
vectors is defined as a set of vectors located within a neighborhood distance (U 0063). 

As per claim 34, a method according to claim 33, Blum further comprising: 
outputting an estimate of the confidence level with which said estimate of the perceptual 
class is correct (col. 12, lines 13-21, col. 14, lines 24-36). 

As per claim 35, a method according to claim 34, Blatter teaches a human 
examines the new unclassified media entity (fl0021, entered manually by experts in the 
particular area of media). And Blum teaches wherein if said estimate of the confidence 




Application/Control Number: 09/934,071 



Page 8 



Art Unit: 2177 

level is low (low-confidence) and said human determines an action (removal) for said 
classification chain data structure based thereon (col. 13, lines 49-52). 

As per claim 38, a method according to claim 35, Blatter teaches wherein the 
new unclassified media entity is rejected from the classification chain as an outlier 
(fl0063, 8-10). 

As per claim 39, a method according to claim 35, Blatter teach the performance 
level of the classification chain improves over time due to the examination of 
unclassified media entities that have a low confidence level associated therewith 
(H 0026). 

As per claim 40, a method according to claim 33, Blatter teaches wherein it is 
determined whether said vector representing said new unclassified media entity has 
been previously processed, thereby obviating the need to re-process said vector via the 
classification chain (fl 0063). 



Blatter et al (US Patent Application 2003/0014407 A1 ) discloses that "still other 
systems are reliant on Digital Signal Processing (DSP) technology. DSP, however, is 
very ineffective in finding songs which "sound similar" to a given song because it can 
only match simple music characteristics, such as tempo, rhythm, and instrumentation. 
Human perception of musical similarity is a far more complex combination of 
many inputs, some of which are still unknown" (1J0004). 



Allowable Subject Matter 
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Claim 36 is allowable because the prior art record fails to teach or fairly suggest 
that a human adds a new subset of perceptual properties to the classification chain data 
structure defined by the new unclassified data structure. 

Claim 37 is allowable because the prior art record fails to teach or fairly suggest 
that a human modifies an existing subset of perceptual properties represented by the 
classification chain data structure in accordance with the results of the human 
examinations. 

Claims 36-37are objected to as being dependent upon a rejected base claim, but 
would be allowable if rewritten in independent form including all of the limitations of the 
base claim and any intervening claims. 

Conclusion 

If a reference indicated as being mailed on PTO-FORM 892 has not been 
enclosed in this action, please contact Lisa Craney whose phone number is (703) 305- 
9601 for faster service. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to DEBBIE M LE whose telephone number is 703-308- 
6409. The examiner can normally be reached on 8:30-5:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, JOHN BREENE can be reached on 703-305-9790. The fax phone number 
for the organization where this application or proceeding is assigned is 703-746-7239. 
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Any inquiry of a general nature or relating to the status of this application or 
proceeding should be directed to the receptionist whose telephone number is 703-305- 
3900. 



DEBBIE M LE 
Examiner 
Art Unit 2177 




Debbie Le 
Jan. 6, 2004. 




PRIMARY EXAMINER 



